Training Quality Evaluators

Improving quality models for MT evaluation based on evaluators’ feedback

The Framework for the Evaluation for Machine Translation (FEMTI) contains guidelines for building a quality model that is used to evaluate MT systems in relation to the purpose and intended context of use of the systems. Contextual quality models can thus be constructed, but entering into FEMTI the knowledge required for this operation is a complex task. An experiment has been set up in order t...

Of what quality be the UCSB resources evaluators?

To respond to Padlipsky’s example of UCSB botching login attempts let me make two comments. First, more people than the resource evaluators were accessing the ARPANET. The group of evaluators, at least, knew the login procedure from the Resource Notebook. (By the way, we do have a Multics Programmers Manual.) Second, the OLS TELNET echoes no lower case, which can generate confusion. Even UCSB’s...

Semantical Evaluators

In the context of a possibilistic framework for detection of object co-reference, evaluators have been defined as operators that compare two values and express the belief that such values are co-referent. Hereby, co-reference of two values means that these values describe the same entity in the real world. In this paper, a class of evaluators is investigated that determines the belief of co-ref...

Symbolic Mathematics System Evaluators

Evaluation of expressions and programs in a computer al gebra system is central to every system but inevitably fails to provide complete satisfaction Here we explain the con icting requirements describe some solutions from current systems and propose alternatives that might be preferable sometimes We give examples primarily from Axiom Mac syma Maple Mathematica with passing mention of a few oth...

Eecient Neural Net --evaluators